Image operator learning coupled with CNN classification and its application to staff line removal

Many image transformations can be modeled by image operators that are characterized by pixel-wise local functions defined on a finite support window. In image operator learning, these functions are estimated from training data using machine learning techniques. Input size is usually a critical issue when using learning algorithms, and it limits the size of practicable windows. We propose the use of convolutional neural networks (CNNs) to overcome this limitation. The problem of removing staff-lines in music score images is chosen to evaluate the effects of window and convolutional mask sizes on the learned image operator performance. Results show that the CNN based solution outperforms previous ones obtained using conventional learning algorithms or heuristic algorithms, indicating the potential of CNNs as base classifiers in image operator learning. The implementations will be made available on the TRIOSlib project site.Comment: To appear in ICDAR 201

Clinicopathological characteristics of patients with oropharyngeal squamous cell carcinoma (N = 98).

<p>Clinicopathological characteristics of patients with oropharyngeal squamous cell carcinoma (N = 98).</p

Clinical and imaging parameters of patients with oropharyngeal squamous cell carcinoma according to p16 status (N = 98).

<p>Clinical and imaging parameters of patients with oropharyngeal squamous cell carcinoma according to p16 status (N = 98).</p

A 46-year-old male patient with left tongue base oropharyngeal squamous cell carcinoma and cystic nodal metastasis.

<p>(A) T1-weighted, (B) fat-suppressed T2-weighted, and (C) contrast-enhanced fat-suppressed T1-weighted MRI images show an enlarged cystic lymph node (arrow) in the left neck level IIA with a thin, well-defined smooth margin, and central homogeneous fluid content. (D) T1-weighted MRI three months after completion of chemoradiotherapy shows regression of the neck node. The patient was disease-free during three years of clinical and imaging follow-up.</p

Immunohistochemical staining of α-SMA and CD40 nuclei in LV myocardium.

<p><b>Upper panel:</b> α-SMA immunohistochemical staining (200x) showing notably lower number of small vessel (red arrows) after ischemia (<b>B</b>) than in normal controls (<b>A</b>) and ischemia with shock wave treatment (<b>C</b>). †p<0.002 between the indicated groups (<b>D</b>). Scale bars in right lower corner represent 50 µm. <b>Lower Panel:</b> IHC staining (400x) showing the CD40-positively stained cells were remarkably higher after ischemia (<b>F</b>) than in normal controls (<b>E</b>) and ischemia with shock wave treatment (<b>G</b>). †p<0.001 between the indicated group (<b>H)</b>. Scale bars in right lower corner represent 20 µm.</p

Kaplan-Meier analysis of local control rate stratified according to the median value of <i>K</i>^<i>trans</i>.

<p>Kaplan-Meier analysis of local control rate stratified according to the median value of <i>K</i>^<i>trans</i>.</p

Scatterplots of SUV_max in the local control (LC, <i>n</i>= 41) and local failure (LR, <i>n=17</i>) groups.

<p>Scatterplots of SUV_max in the local control (LC, <i>n</i>= 41) and local failure (LR, <i>n=17</i>) groups.</p

Multivariate analyses of 3-year neck control and overall survival rates according to the prognostic scoring system based on hemoglobin levels, <i>V_e</i>, and ADC.

<p>HR indicates hazard ratio; CI, confidence interval.</p><p>Multivariate analyses of 3-year neck control and overall survival rates according to the prognostic scoring system based on hemoglobin levels, <i>V_e</i>, and ADC.</p

Scatterplots of <i>K</i>^<i>trans</i> in the local control (LC, <i>n</i>= 41) and local failure (LR, <i>n=17</i>) groups.

<p>Scatterplots of <i>K</i>^<i>trans</i> in the local control (LC, <i>n</i>= 41) and local failure (LR, <i>n=17</i>) groups.</p

Immunohistochemical staining of fibrosis and apoptotic nuclei in LV myocardium.

<p><b>Upper Panel:</b> TUNEL assay (400x) showing notably higher number of apoptotic nuclei (red arrows) after ischemic insult (<b>B</b>) compared with normal controls (<b>A</b>) and ischemia following shock wave treatment (<b>C</b>). †p<0.001 between the indicated groups (<b>D</b>). Scale bars in right lower corner represent 20 µm. n = 6 in each group. <b>Lower Panel:</b> Masson's Trichrome staining (100×) showing remarkably higher fibrotic area (blue) following ischemia (<b>F</b>) than in normal controls (<b>E</b>) and ischemia with shock wave treatment (<b>G</b>). †p<0.0001 between the indicated groups (<b>H</b>). Scale bars in right lower corner represent 100 µm. n = 6 in each group.</p